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PREFACE 


This  report  documents  the  results  of  USAFETAC  Project  920136,  which  was  accomplished  in 
response  to  a  request  from  the  46th  TW/DOW  at  Eglin  AFB,  FL.  The  requester  asked 
USAFETAC  to  validate  an  empirically  based  forecast  technique  (  WINNDEX)  by  comparing  its 
performance  to  the  actual  occurrence  of  air-mass  thunderstorms  during  the  inclusive  May  to 
September  time  period. 

In  addition  to  validating  the  WINNDEX  technique,  USAFETAC  developed  two  discriminant 
analysis  models  to: 

•  Predict  when  the  first  lightning  strike  will  occur. 

•  Provide  the  probability  of  occurrence  of  thunderstorm  activity  during  four  3-hour 
periods  begiiming  at  I200Z. 

Both  these  models  were  independently  verified. 
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1.  INTRODUCTION 


1.1  Background.  The  46th  TW  conducts 
weapons  testing  over  the  large  land  and 
water  ranges  of  Eglin  AFB.  i .  May  to 
September,  the  predominant  weather 
phenome'^on  affecting  weapons  testing 
operation^  is  the  air-mass  thunderstorm. 
Because  accurate  thunderstorm  forecasting 
is  crucial  to  providing  decision-makers  the 
data  needed  to  schedule  weather-sensitive 
tests,  Eglin  staff  meteorologist  Mr  Roger 
Winn  (since  retired)  developed  an 
empirically  based  technique  to  predict  the 
timing  (and,  to  some  extent,  the  location)  of 
air-mass  thunderstorm  activity  at  Eglin  AFB. 
His  technique  (called  "WINNDEX")  is 
based  on  data  collected  for  May  through 
September  of  1986.  The  ifs,  when's,  and 
where's  of  predicting  air-mass  thimderstorms 
at  Eglin  AFB  are  influenced  by  moisture, 
stability  and  upper-  and  lower-level  wind 
flows.  Building  on  earlier  techniques 
(Forsing,  1970),  Mr  Winn  developed  his 
WINNDEX  to  forecast  sea-breeze 
thunderstorm  development  at  Eglin  AFB. 
Although  WINNDEX  has  been  used  as  a 
forecasting  aid  at  Eglin  AFB  since  1987,  its 
effectiveness  has  never  been  formally 
documented.  This  study  was  undertaken, 
then,  to  provide  WINNDEX  verification 
statistics  for  the  months  of  May  to 
September  in  the  years  1986-1990. 
USAFETAC  also  developed  discriminant 
analysis  procedures  to  improve  the  timing  in 
predicting  the  occurrence  of  thimderstorms 
on  Eglin  Main  and  on  the  Eglin  Ranges.  In 
both  cases,  the  study  showed  the  utility  of 
using  recorded  lightning  strikes  to  develop 
and  verify  a  thunderstorm  forecasting 
technique. 


1.2  Components  of  the  Study. 

1.2.1  WINNDEX  Validation.  First,  the 
WINNDEX  convective  forecast  was 
compared  against  recorded  lightning  strikes 
and  observed  weather  on  days  when  the 
Showalter  Index  was  less  than  5  (the  first 
WINNDEX  criteria  for  convective  activity). 
Second,  forecast  skill  measures  based  on 
verification  with  recorded  lightning  strikes 
only  were  compared  with  verification  based 
on  recorded  lightning  strikes  and  surface 
observations. 

1.2.2  Disciiminant  Analysis.  Discriminant 
analysis  procedures  were  used  to: 

•  Classify  observations  based  on  the 
occurrence  of  the  first  lightning  strike. 

*  Develop  a  model  (discriminant 
function)  that  can  be  used  to  assign  the 
probability  of  occurrence  of 
thunderstorms  on  the  Eglin  ranges  and 
at  the  Eglin  aerodrome  (Eglin  main) 
during  four  3-hour  intervals  beginning 
at  1200Z.  These  models  were  verified 
using  an  independent  data  set. 

1.3  Data  Sources.  The  data  used  in  this 
study  consisted  of  surface  observations  from 
Eglin  AFB  and  nearby  Hurlburt  Field, 
upper-air  observations  from  Eglin  AFB  and 
Apalachicola,  FL,  and  recorded  lightning 
strike  data  from  the  National  Lightning 
Detection  Network  (Geomet  Dynatec  Inc, 
Tucson,  AZ).  The  period  of  record  for  all 
datasets  was  from  May  through  September, 
1986-1 990.  Only  weather  occurring  between 
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the  hours  of  0600  and  2400Z  was 
considered.  Typically,  both  convective 
activity  and  flying  operations  drop  off  after 
2400Z.  On  the  days  in  which  convective 
activity  was  expected  throughout  the  day, 
0600Z  or  local  midnight  was  used  as  the 
start  hour. 

For  purposes  of  verifying  the  WINNDEX, 
the  entire  dataset  is  considered  independent 
even  though  the  WINNDEX  was  developed 
using  data  from  1986.  For  the  discriminant 
analysis,  the  data  was  separated  into 
independent  and  dependent  data  sets. 


Because  of  the  limited  number  of  lightning 
strikes  during  certain  hours,  the  days  to 
used  in  the  independent  data  set  could  not 
selected  totally  at  random.  Therefore,  6 
days  of  the  month  were  selected  to  make  up 
the  independent  data  set  so  that  for  low 
lightning  strike  coimts,  about  half  the  strikes 
would  be  included  in  the  independent 
dataset.  The  dependent  dataset  is  used  to 
develop  the  discriminant  models,  which  are 
then  verified  using  the  independent  data  set. 
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2.  CUMATOLOGY 


2.1  Thunderstonn  Distributions.  For 

purposes  of  this  study,  thunderstorm  activity, 
as  indicated  F.  recorded  lightning  strikes 
between  the  u  .^rs  jf  0600  and  2400Z,  is 
stratified  by  and  lower-level  winds. 

This  wind  stratification  is  the  same  as  that 
used  ill  the  WINNDEX— that  is,  the  1200Z 
hour  2, 000- foot  (lower- level)  wind  is 
classified  as  northerly  when  the  v  (north- 
south)  component  is  less  than  zero,  and 
southerly  when  the  v  component  is  greater 
than  or  equal  to  zero.  The  mean  direction  of 
the  winds  at  12-16,000  feet  (upper-level)  is 
classified  as  northerly  when  the  v  component 
is  less  than  or  equal  to  zero,  and  southerly 
otherwise.  The  wind  categories,  then,  are: 

NN  Both  upper-  and  lower-level  winds 
have  a  northerly  component. 

NS  Upper-  level  winds  have  a  northerly 
component;  lower-  level  winds  have  a 
southerly  component. 

SN  Upper-level  winds  have  a  southerly 
component;  lower-level  winds  have  a 
northerly  component. 

SS  Both  upper-  and  lower-level  winds 
have  a  southerly  component. 

2.1.1  Hourly  Distribution.  Because  of  the  size 
of  the  Eglin  Range  complex,  the  upper- 
level  (steering)  wind  flow  doesn't  have  much 
effect  on  the  frequency  of  thunderstorm 
activity  (as  inferred  from  recorded  lightning 
strikes-see  Figures  1  &  2).  However,  the 
influence  of  the  boimdary-layer  wind  is 
apparent.  With  northerly  boundary-level 
flow,  a  secondary  peak  in  activity  during 
early  morning  becomes  apparent.  This  is  the 
result  of  land-breeze  activity  moving 


onshore.  This  secondary  peak  is,  of  course, 
more  evident  with  southerly  steering  winds. 
Southerly  flow  in  the  boimdaiy  layer  at 
1200Z  indicates  that  the  land  breeze,  if  any, 
was  weak  and  that  the  enhanced  sea  breeze 
will  result  in  increased  (and  earlier) 
convective  activity. 

Although  distributions  for  thxmderstorm 
activity  on  Eglin  Main  (Figures  3  &  4)  are 
similar  to  those  for  the  Eglin  Range,  there 
are  some  pronounced  differences.  First,  the 
secondary  peak  with  northerly  boundary- 
layer  flow  is  not  as  evident,  especially  when 
the  steering  winds  are  out  of  the  north.  This 
is  probably  due  to  the  fact  that  much  of  the 
convective  activity  dissipates  as  it  moves  on¬ 
shore,  resulting  mostly  in  rain  showers. 
Eglin  Main  is  not  large  enough  to  pick  up  as 
many  of  the  widely  scattered  thunderstorms 
that  occur  on  the  much  larger  Eglin  Range. 
Also,  when  both  the  upper-  and  lower-level 
winds  have  southerly  components,  the  peak 
activity  occurs  decidedly  earlier  in  the  day 
as  the  afternoon  convective  activity  occurs 
farther  inland-that  is,  north  of  Eglin  Main. 

2.1.2  Thro0~Hourty  Distribution.  For  the 
purposes  of  developing  a  thimderstorm 
prediction  model  based  on  discriminant 
analysis,  lighming  strikes  were  biimed  into 
3-hourly  intervals.  Figures  5-8  give  the 
frequency  of  occurrence  of  at  least  one 
lightning  strike  during  these  3 -hour  time 
periods  for  Eglin  Main  and  the  Eglin  Ranges 
for  each  of  the  four  wind  stratifications.  For 
comparison  to  the  posterior  probabilities 
determined  using  the  discriminant  function 
in  calculation  of  the  discriminant  analysis 
model's  Brier  Skill  Score,  these  occurrence 
frequencies  are  interpreted  as  climatological 
probabilities  of  occurrence. 
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Figure  1.  Frequency  of  occurrence  of  at  least  one  lightning  strike  on  the  Eglin  Range  during  indicated 
hour  for  May  through  September  period  when  upper-level  winds  have  a  northerly  component  and  lower- 
level  winds  have  a  northerly  (a),  southerly  (b)  component 
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Figure  2.  Frequency  of  occurrence  of  at  least  one  lightning  strike  on  the  Eglin  Range  during  indicated 
hour  for  May  through  September  period  when  upper  level  winds  have  a  southerly  component  and  lower 
level  winds  have  a  northerly  (a),  southerly  (b)  component 
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Figura  3.  Frequency  of  occurrence  of  at  least  one  lightning  strike  on  Eglin  Main  during  indicated  hour 
for  May  through  September  period  when  upper  level  winds  have  a  northerly  component  and  lower  level 
winds  have  a  northerly  (a),  southerly  (b)  component 
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Figur*  4.  Frequency  of  occurrence  of  at  least  one  lightning  strike  on  Eglin  Main  during  indicated  hour 
for  May  through  September  period  when  upper  level  winds  have  a  southerly  component  and  lower  level 
winds  have  a  northerly  (a),  southerly  (b)  component 
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Figure  S.  Frequency  of  occurrence  of  at  least  one  lightning  strike  on  Eglin  Range  during  three  hour 
period  beginning  with  indicated  hour  for  May  through  September  period  when  upper  level  winds  have 
a  northerly  component  and  lower  level  winds  have  a  northerly  (a),  southerly  (b)  component 
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Figure  e.  Frequency  of  occurrence  of  at  least  one  lightning  strike  on  Egiin  Range  during  three  hour 
period  beginning  with  indicated  hour  for  May  through  September  period  when  upper  level  winds  have 
a  southerly  component  and  lower  level  winds  have  a  northerly  (a),  southerly  (b)  compottent 


9 


°  6  9  12  15  18  21 


HOUR  (Z) 
(b) 


Figure  7.  Frequency  of  occurrence  of  at  least  one  lightning  strike  on  Eglin  Main  during  three  hour  period 
beginning  with  indicated  hour  for  May  through  September  period  when  upper  level  winds  have  a 
northerly  component  and  lower  level  winds  have  a  northerly  (a),  southerly  (b)  component 
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Figure  t.  Frequency  of  occurrence  of  at  least  one  lightning  strike  on  Eglin  Main  during  three  hour  period 
beginning  with  indicated  hour  for  May  through  September  period  when  upper  level  winds  have  a 
southerly  component  and  lower  level  winds  have  a  northerly  (a),  southerly  (b)  component 
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3.  WINNDEX  VAUDATION _ 

3.1  WINNDEX  Forecast  Procedure.  The 

procedures  for  forecasting  air-mass 

thunderstorms  with  WINNDEX  are  as 

follows; 

•  Determine  the  homogeneity  of  the  air 
mass  across  the  central  Gulf  Coast  region 
based  on  the  distributions  of  temperature 
and  moisture.  WINNDEX  is  valid  only 
when  the  air  mass  across  this  region  is 
homogeneous;  the  presence  of  a  frontal 
system  or  upper-level  low  precludes  the 
use  of  the  WINNDEX  technique. 

•  Calculate  the  Showalter  Stability  Index 
(SSI)  from  the  1200Z  upper-air  sounding. 
Values  greater  than  or  equal  to  +5°C 
indicate  that  the  air  mass  is  too  stable  for 
thunderstorm  development. 

•  Determine  the  mean  direction  of  the 
steering  winds  between  12,000  and  16,000 
feet.  Use  Figure  9  for  southerly  (090°  - 
270°)  mean  wind  directions  and  use 
Figure  10  with  northerly  (275°  -  085°) 
mean  wind  directions. 

•  Calculate  the  convective  condensation 
level  (CCL). 

•  Add  the  temperature/dew-  point  spreads 
(T  -  Tj)  at  the  700-,  600-,  and  500-mb 
levels. 


•  If  the  2,000-foot  wind  is  northerly  (270- 
090°),  use  the  right  side  (b)  of  Figures  9 
&  10  to  determine  the  WINNDEX 
forecast  by  the  intersection  of  the  CCL 
and  dew  point  depression  sum  (DPD). 

*  If  the  2, 000- foot  wind  is  southerly  (090- 
270°),  use  the  left  side  (a)  of  Figures  9  & 
1 0  to  determine  the  WINNDEX  forecast 
by  the  intersection  of  the  CCL  and  dew 
point  depression  sum  (DPD). 

3.2  Data  Sources  and  Methodology. 

Inputs  to  WINNDEX  were  derived  from 
upper-air  DATSAV  for  Eglin  AFB  and 
Apalachicola,  FL,  from  1  May  to  30 
September,  1986-1990.  Apalachicola  upper- 
air  data  was  used  on  days  for  which  there 
was  no  data  for  Eglin.  Of  the  706  12Z 
soundings  available  for  analysis,  374  (53%) 
were  from  Eglin  and  332  (47%)  were  from 
Apalachicola.  The  Showalter  stability 

indices  were  taken  directly  from 
USAFETAC's  DATSAV  database,  where 
they  are  recorded  in  whole  degrees  C.  The 
CCLs  were  calculated  using  the  method 
outlined  in  AWS  TR-83-001,  Equations  and 
Algorithms  for  Meteorological  Applications 
in  Air  Weather  Service,  with  one  exception; 
the  bottom  50  mb  (rather  than  100  mb  as 
called  for  in  the  technical  report)  was  used 
to  define  the  moist  layer. 
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270 


Figure  9.  Nomogram  used  to  determine  WINNDEX  forecast  when  upper-level  winds  have  a 
northerly  component  and  lower-level  winds  have  a  southerly  (a),  northerly  (b)  component. 
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Figure  10.  Nomogram  used  to  determine  WINNDEX  forecast  whm  upper-level  winds  have  a 
southerly  component  and  lower-level  winds  have  a  southerly  (a)  northerly  (b)  component. 
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The  WINNDEX  was  determined  for  all  days 
in  which  the  Showalter  stability  index  was 
less  than  5.  This  occurred  on  558  (79%)  of 
the  706  days  used  in  the  study.  As 
previously  agreed  upon  with  the  46th 
TW/DOW,  no  attempt  was  made  to  exclude 
days  in  which  use  of  the  WINNDEX  would 
be  inappropriate  due  to  the  synoptic  situation 
(e.g.,  a  front  or  upper-level  low  in  the  area). 
It  should  be  noted  that  when  verifying  a 
similar  thunderstorm  forecasting  technique, 
Forsing  (1970)  attributed  12%  of  the 
unforecast  convective  activity  to  the 
presence  of  an  upper-level  trough. 

For  initial  verification  purposes,  convective 
activity  was  said  to  have  occurred  on  Eglin 
Main  whenever  an  Eglin  surface  observation 
reported  rain,  rain  shower,  thunder,  or 
thundershower  and/or  a  lightning  strike 
occurred  within  5  nm  of  30°  29'  N  and  86° 
32’  W. 

Verification  of  the  Eglin  Range  forecast  was 
based  on  Eglin/Hurlburt  surface  observations 
and  recorded  lightning  strikes  within  an  area 
defined  by  30°  45’  N,  86°  55’  W,  and  30° 
20’  N,  86°  05’  W. 

Verification  was  considered  in  two  ways: 
first,  the  occurrence  or  nonoccurrence  of 
convective  activity  during  the  day  regardless 
of  when  it  occurred,  and  second,  the  timing 
of  the  activity.  Verifications  were  compared 
in  two  ways:  those  using  only  lightning 


data  and  those  using  both  lightning  data  and 
surface  observations.  For  both  forecasts  and 
observations,  0600Z  was  the  first  hour  of  the 
day.  Therefore,  when  the  WINNDEX 
forecast  convective  activity  all  day,  forecast 
start  time  is  0600;  only  lightning  strikes  and 
surface  observations  at  or  after  this  hour 
were  considered  for  verification. 

3.2.1  Skin  Scores.  For  a  simple  "YES/NO” 
categorical  forecast,  we  can  construct  a  2  x 
2  contingency  table  (for  example.  Table  1) 
from  which  several  measures  of  ’’skill"  can 
be  derived.  "Percent  correct"  is  simply  the 
number  of  correct  forecasts  (YES  or  NO) 
expressed  as  a  percentage  of  the  number  of 
forecasts  made.  The  probability  of  detection 
(POD)  is  the  number  of  YES  forecasts  made 
expressed  as  a  percentage  of  the  total 
number  of  YES  events  (thunderstorms) 
observed.  The  false  alarm  rate  (FAR)  is  the 
number  of  unverified  YES  forecasts 
expressed  as  a  percentage  of  the  total 
number  of  YES  forecasts  made.  The  Heidke 
skill  score  (HSS)  assesses  the  skill  of  a 
forecast  method  against  that  of  chance. 
Because  the  HSS  is  "trial  dependent"  (i.e., 
any  analysis  in  which  the  YES  and  NO 
events  are  not  equally  represented  is  biased), 
Hanssen  and  Kuipers  (from  Woodcock, 
1976)  developed  the  trial-independent 
discriminant  "V"  score.  The  HSS  and  ”V’’ 
scores  range  from  -1  (no  skill)  to  +1  (perfect 
skill);  zero  implies  that  the  forecast  method 
is  no  better  than  chance. 
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TABLE  1.  Sample  contingency  table  for  YES/NO  categorical  forecast. 


FORECAST  1 

YES 

NO  1 

O 

Y 

B 

E 

#  of  occurrences  (A) 

#  of  occurrences  (B)  | 

s 

S 

I 

E 

R 

N 

V 

E 

0 

#  of  occurrences  (C) 

#  of  occurrences  (D) 

D 

The  measures  of  skill  used  here  to 
summarize  the  verification  results,  defined  in 
terms  of  the  elements  of  the  above 
contingency  table,  are; 


•  Heidke  Skill  Score  - 

uss  =  _ 2{AD  -  5Q _ 

{A  *  *  (A  *  Q(C  *  D 


•  Percent  Correct  - 


%  Correct  « 


A*  D 

A  +  B  +  C  +  D 


•  Probability  of  Detection  - 


POD  » 


A 

A  *  B 


•  False  Alarm  Rate  - 


FAR 


C 

A  ♦  C 


•  Hanssen  and  Kuipers’  discriminant  "V"  - 

V  xo  -  BC 
■  [(^  .  fl)  .  (C  -  £^1 

3.3  Forecast  Distribution.  Figures  11-14 
give  the  distribution  of  WINNDEX  forecast 
variables  when  a  lightning  strike  was 
recorded  on  the  Eglin  Range.  Categories  are 
labeled  to  simplify  identification  during  the 
presentation  of  results.  Tables  2-S  give  the 
WINNDEX  forecast  associated  with  each 
category,  along  with  the  number  and 
perecentage  of  times  this  forecast  was  made 
based  on  the  total  number  of  days  the 
WINNDEX  was  determined  (i.e.,  558). 
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Figure  11  CCL  vs  DPO  for  WINNOEX  determination  when  both  upper-  and  lower-level  winds  have 
northerly  components  and  a  lightning  strike  was  recorded  on  the  Eglin  Range. 


TABLE  E.  WINNDEX  forecast  categories  and  their  frequency  of  occurrence  when  both  upper-  and 
lower-level  winds  have  northerly  components  during  the  May  through  September  period  for  the 
years  1986-1990. 


Forecast 

WINNDEX 

Category 

Range 

Eglin  Main 

Frequency 

Percent 

NONE 

NONE 

NONE 

52 

9 

NN1 

TRW  17-012 

TRW  20-002 

28 

5 

NN2 

TRW  19-012 

TRW  21-002 

30 

5 

NN3 

TRW/RW  16-002 

TRW/RW  16-002 

14 

2 

NN4 

TRW/RW  10-182 

TRW/RW  10-182 

11 

2 

17 


90 


80 


\o\: 


Figure  12  CCL  vs  OPO  for  WINNOEX  determinalion  when  upper-level  winds  have  a  northerly  component  and  lower-level  winds 
have  a  southerly  component  and  a  lightning  strike  was  recorded  on  the  Eglin  Range. 


TABLE  3.  WINNDEX  forecast  categories  and  their  frequency  of  occurrence  when  upr  ^r-level 
winds  have  a  northerly  component  and  lower-level  winds  have  a  southerly  component  during  the 
May  through  September  period  for  the  years  1986-1990. 


WINNDEX 

Categb.y 

Forecast 

Frequency 

Percent 

Range 

Eglin  Main 

NONE 

NONE 

NONE 

30 

5 

NS1 

TRW  17-01Z 

TRW  21-OOZ 

19 

3 

NS2 

TRW  19-01Z 

TRW  18-23Z 

14 

2 

NS3 

TRW/RW  14-OOZ 

TRW/RW  16-01Z 

28 

5 

18 


have  a  ncrtherty  component  and  a  lightning  strike  was  recorded  on  the  Eglin  Range. 


TABLE  4.  WINNDEX  Forecast  categories  and  their  frequency  of  occurrence  when  upper-level 
winds  have  a  southerly  component  and  lower-level  winds  have  a  northerly  component  during  the 
May  through  September  period  for  the  years  1986-1990. 

WINNDEX 

Category 

Forecast 

Frequency 

Percent 

Range 

Eglin  Main 

NONE 

NONE 

NONE 

42 

8 

SN1 

TRW  17-23Z 

NONE 

17 

3 

SN2 

RW/TRW  17-OOZ 

RW/TRW  17-21Z 

17 

3 

SN3 

RW/TRW  ALL  DAY 

RW/TRW  ALL  DAY 

6 

1 

19 
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0 
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Figure  14  CCL  vs  DPD  tor  WINNOEX  determination  when  both  upper-  and  lower-level  winds  have  southerly  components 
and  a  lightning  strike  was  recorded  on  the  Eglin  Range. 


TAIUE  S.  WINNDEX  forecast  categories  and  their  frequency  of  occurrence  when  both  upper-  and 
lower-level  winds  have  a  southerly  component  during  the  May  through  September  period  for  the 
years  1986-1990. 


WINNDEX 

Category 


NONE 


SSI 


SS2 


SS3 


SS4 


SS5 


SS6 


SS7 


Forecast 

Range 

Eglin  Main 

NONE 

NONE 

TRW  15-01Z 

NONE 

TRW  17-01Z 

NONE 

TRW  19-01Z 

NONE 

TRW  16-01Z 

T  16-01Z 

TRW  18-01Z 

T  18-20Z 

TRW  15-01Z 

TRW/RW  10-19Z 

RW/TRW  AU  DAY 

RW/TRW  ALL  DAY 

Frequency 


40 


24 


Percent 


20 


3.4  Verification.  Lightning  or  a  verifiable 
surface  observation  was  recorded  on  41 
(28%)  and  33  (22%)  of  the  148  days  when 
the  SSI  was  greater  than  or  equal  to  five  for 
the  Eglin  Ranges  and  Eglin  Main 
respectively.  Thunderstorms  occurred  on  95 
(58%)/107  (48%)  of  the  164/223  days  that 
the  WINNDEX  forecast  no  thunderstorm 
activity  for  the  Eglin  Ranges/Eglin  Main. 


Table  6  gives  the  number  (percentage)  of 
days  by  category  the  WINNDEX  correctly 
forecast  the  occurrence  of  convective  activity 
and  2)  the  average  time  difference  between 
forecasted  time  of  onset  of  convective 
activity  and  the  first  observed  occurrence  of 
convective  activity  (either  lightning  strike  or 
surface  report). 


TABLE  6.  Frequency  of  occurrence  of  forecasted  convective  activity  and  average  time 
difference  (Time  Diff)  between  the  onset  of  convective  activity  and  the  first  observed 
occurrence  of  convective  activity  by  category  of  forecast 

Category 

Eglin  Range 

Eglin  Main  f 

Frequency  (%) 

Time  Difi 
(minutes) 

Frequency  (%) 

Time  Diff 
(minutes) 

NN1 

19  (68) 

-38 

17  (61) 

-146 

NN2 

22  (73) 

-182 

21  (70) 

-276 

NN3 

11  (79) 

122 

10  (71) 

110 

NN4 

11  (100) 

274 

10  (91) 

364 

NS1 

10  (S3) 

40 

7(37) 

-273 

NS2 

7(50) 

-130 

6(43) 

47 

NS3 

21  (75) 

56 

20  (71) 

-34 

SN1 

13  (77) 

-83 

N/A 

N/A 

SN2 

14  (82) 

-148 

14  (82) 

-58 

SN3 

3  (50) 

418 

3  (50) 

626 

SSI 

18  (75) 

-97 

N/A 

N/A 

SS2 

5(63) 

172 

N/A 

N/A 

SS3 

5(50) 

-435 

N/A 

N/A 

SS4 

15  (71) 

-179 

15(71) 

-161 

SS5 

15  (79) 

-284 

14  (74) 

-239 

SS6 

66  (93) 

-109 

59  (83) 

196 

SS7 

55  (97) 

330 

52  (91) 

323 

21 


For  all  days  in  the  study,  the  PODs  for 
convective  activity  on  the  Eglin  Range  and 
Eglin  Main  are  69%  and  64%,  respectively. 
The  differences  between  observed  and 
forecast  time  of  first  occurrence  of 
convective  activity  varies  widely.  Some  of 
the  largest  differences  were  associated  with 
the  "all  day"  category.  As  you’ll  recall,  on 
these  days  the  beginning  of  convective 
activity  for  both  observational  and  forecast 
puiposes  was  0600Z. 

Table  7  compares  verification  results  based 
only  on  recorded  lighting  strikes  to  those 
using  both  lightning  strikes  and 
surfaceobservations.  For  a  large  area  such 


as  the  Eglin  Range,  there  is  little  difference 
between  verification  results  using  both 
lightning  and  surface  observations  and  those 
just  using  lightning  data.  But  in  a  small 
area  such  as  Eglin  Main  (100  nm^)  the 
differences  are  larger.  In  both  cases,  the 
largest  percentage  difference  between 
verification  results  is  for  the  false  alarm 
ratio.  Some  of  the  difference  is  attributed  to 
the  fact  that  not  all  convective  activity  will 
result  in  lightning,  especially  during  the 
morning  hours.  It  should  also  be  noted  that 
the  locational  error  associated  with  the 
lightning  database  is  between  3  and  6  nm 
nationwide. 


TABLE  7.  Percent  correct  forecast,  probability  of  detection  (POD),  folse  alarm  rate  (FAR),  1 
Heidke  skill  score  (HSS)  and  H&K  discriminant  'V*  score  for  WINNDEX  YES/NO  categorical  | 
forecast  for  Eglin  Range  and  Eglin  Main  when  forecast  verified  by  surfoce  reports  and  1 
lightning  strikes  and  by  lightning  strikes  alone.  | 

EGLIN  RANGE 

EGLIN  MAIN  | 

Surface  Report 
&  Lightning 

Lightning 

only 

Surface  Report 
&  Lightning 

Lightning  I 
only  1 

%  Correct 

68 

64 

65 

56 

POD 

77 

77 

70 

72 

FAR 

21 

31 

26 

56 

HSS 

.21 

.18 

.26 

.17 

.22 

.18 

.27 

.19 

In  Tables  6  &  7,  a  forecast  was  considered 
"correct"  if  convective  activity  occurred  at 
some  point  during  the  day.  A  more  strict 
verification  would  consider  the  forecast 
correct  only  when  convective  activity  occurs 


during  the  time  period  specified  by  the 
forecast.  If  the  stricter  rule  is  used, 
however,  there  is  little  reduction  in  the 
percentage  of  correct  forecasts  (1%  for  Eglin 
Range  and  S%  for  Eglin  Main). 
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3.5  Conclusion.  The  WINNDEX  showed 
fair  skill  in  forecasting  the  occurrence  and 
timing  of  convective  activity.  In  all  706 
days  of  the  study,  WINNDEX  correctly 
predicted  the  occurrence  of  convective 
activity  69%  of  the  time  on  the  Eglin  range 
and  64%  of  the  time  on  Eglin  Main.  False 
alarm  rates  (21%  for  the  Eglin  Range  and 
26%  for  Eglin  Main)  were  good.  However, 
the  mean  absolute  time  difference  between 
the  forecast  and  observed  time  of  the  onset 
of  convective  activity  (as  reported  in  a 
surface  observation  or  as  a  recorded 
lightning  strike)  was  171  minutes  for  the 


Eglin  Range  and  213  minutes  for  Eglin 
Main.  Although  much  of  this  timing  error 
can  be  attributed  to  the  "all  day"  activity 
commencing  much  later  than  the  assumed 
start  time  of  0600Z,  changes  in  WINNDEX 
categories  may  be  needed  to  improve  the 
timing  of  the  technique.  For  this  project,  we 
decided  to  use  a  multivariate  statistical 
classification  technique  called  "discriminant 
analysis"  in  an  attempt  to  improve 
thunderstorm  forecasting  for  the  Eglin  Range 
and  Eglin  Main.  That  technique  is  described 
in  Section  4. 


23 


4.  DISCRIMINANT  ANALYSIS. _ 

4.1  Introduction.  Discriminant  Analysis  used  in  the  independent  dataset  could  not  be 

classifies  individtial  observations  into  groups.  selected  totally  at  random;  6  days  of  the 

It  is  a  supervised  classification  in  that  we  month  were  selected  to  make  up  the 

identify  the  groups  into  which  we  would  like  independent  dataset  in  such  a  manner  that 

our  observation  classified.  In  this  case,  two  for  low  strike  counts,  about  half  the  strikes 

different  classifications  will  be  performed.  would  be  included  in  the  independent 

First,  we  will  classify  the  observations  into  dataset.  The  dependent  data  was  used  to 

3-hour  intervals  beginning  at  1200Z  for  the  develop  the  discriminant  functions  which 

occurrence  of  the  first  lightning  strike  of  the  were  then  used  to  classify  the  independent 

day.  Second,  we  provide  a  YES  or  NO  data.  Using  the  four  predictors,  .he  first 

classification  for  thunderstorm  occurrence  discriminant  analysis  predicts  during  which 

for  the  four  3-hour  intervals  beginning  at  3-hour  interval  the  first  lightning  strike  will 

1200Z.  In  other  words,  om  first  analysis  occur.  The  second  analysis  provides  a 

will  forecast  during  which  3-hour  period  the  YES/NO  classification  for  thunderstorm 

first  lightning  strike  will  occur;  the  second  activity  during  the  four  3-hour  periods 

analysis  will  give  a  YES/NO  forecast  for  beginning  at  1200Z.  Both  analyses  are 

each  time  period.  stratified  according  to  upper-  and  lower-level 

winds  in  the  same  manner  as  for  the 

4.2  Predictor  Variables.  The  predictor  WINNDEX.  Additionally,  only  lightning 

variables  used  in  the  discriminant  analysis  data  was  used  to  determine  "occurrence"  or 

are  the  Showalter  Index  (SSI),  convective  "nonoccurrence"  in  the  model  development 

condensation  level  (CCL),  sum  of  dew-point  and  verification  processes. 

depressions  aloft  (DPD)  and  the  level  of  fi-ee 

convection  (PLFC).  4.4  First  Strike  Classification.  The  error 

matrices  associated  with  the  independent 

4.3  Methodology.  The  data  was  divided  classification  of  the  first  strike  are  given  in 

into  dependent  and  independent  data  sets.  the  Appendix.  The  overall  classification 

Because  of  the  limited  number  of  lightning  accuracy  results  are  given  in  Table  8. 

strikes  during  certain  hours,  the  days  to  be 


TABLE  8.  overall  classirication  accuracy  (%  correct)  for  classification  of  first 
lightning  strike  on  Eglin  and  Eglin  Main,  vrinds  as  indicated. 


Wind  category  Eglin  Range  Eglin  Main 


These  results  indicate  the  difficulty  this 
model  has  in  classifiying  when  the  first 
lightning  strike  is  likely  to  occur.  The 
model  may  be  improved  by  adding 
additional  predictors  (such  as  time  of  first 
strike  on  the  previous  day),  but  this  was  not 
attempted.  It  may  very  well  be  that  this  is 
the  best  one  can  expect  when  taking  only  a 
snapshot  of  atmospheric  conditions  (i.e. 
atmospheric  state  as  depicted  in  the  1200Z 
sounding)  and  not  factoring  in  the  change 
and/or  rate  of  change  in  atmospheric 
conditions  over  time. 

4.5  YES/NO  Thunderstomi  Forecast  In 

this  analysis,  the  "discriminant"  is  the 
surface  in  four-  (the  number  of 


predictor  variables)  dimensional  space  that 
separates  a  "YES"  from  a  "NO" 
classification.  The  discriminant  model 
returns  a  value  between  0  and  1  which 
relates  to  the  distance  the  point  lies  from  the 
discriminant.  Points  on  the  discrimiirant 
return  a  value  of  O.SO  and  are  associated 
with  a  small  degree  of  classification 
certainty;  points  farther  from  the 
discriminant  return  values  approaching  either 
zero  or  one,  indicating  greater  confidence  in 
a  YES  (1)  or  NO  (0)  classification.  To  the 
first  order,  the  values  returned  from  the 
discriminant  can  be  interpreted  as  an 
estimate  of  the  probability  of  thunderstorms. 
The  independent  classification  results  are 
presented  in  Tables  9  &  10. 
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TABU  9.  Percent  correct  classification,  probability  of  detection  (POD),  false 
alarm  rate  (FAR),  Heidke  skill  score  (HSS),  and  V  discriminant  skill  score  for 
predicting  whether  a  thunderstorm  will  occur  on  the  Eglin  Range  during  a  3- 
hour  period  beginning  with  the  indicated  hour  when  upper-  and  lower-level 
winds  are  as  indicated.  For  the  Eglin  Range,  the  overall  POD  of  thunderstorms 
is  very  good  at  88%  but  the  FAR  is  high  at  52%.  The  numbers  are  similar  for 
Eglin  Main. 


Winds 

Hour  (Z) 

%  Correct 

POD  (%) 

FAR(%) 

HSS 

V 

NN 

1200 

79 

100 

50 

.54 

.73 

NN 

1500 

67 

100 

55 

.39 

.54 

NN 

1800 

79 

94 

29 

.58 

.58 

NN 

2100 

73 

82 

30 

.45 

.45 

NS 

1200 

45 

80 

79 

.08 

.18 

NS 

1500 

55 

88 

63 

.21 

.30 

NS 

1800 

59 

80 

56 

.23 

.27 

NS 

2100 

48 

67 

67 

.05 

.07 

SN 

1200 

70 

100 

53 

.44 

.60 

SN 

1500 

70 

100 

62 

.39 

.64 

SN 

1800 

63 

75 

44 

.27 

.28 

SN 

2100 

56 

60 

57 

.12 

.13 

SS 

1200 

55 

93 

63 

.23 

.35 

ss 

1500 

63 

88 

46 

.29 

.31 

SS 

1800 

70 

90 

35 

.38 

.38 

ss 

2100 

61 

100 

55 

.32 

.42 

ALL 

ALL 

63 

88 

52 

.32 

.38 
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TABLE  10.  Percent  correct  classiflcation,  probability  of  detection  (POD),  false 
alarm  rate  (FAR),  Heidke  skill  score  (HSS),  and  V  discriminant  skill  score  for 
predicting  whether  a  thunderstorm  will  occur  on  Egiin  Main  during  a  B-hour 
period  beginning  with  the  indicated  hour  when  upper-  and  lower-level  winds 
are  as  indicated. 


Hour  (Z)  %  Correct  POD  (%)  FAR  (%) 


100 


86 


73 


74 


33 


78 


67 


75 


86 


Winds 

Hour  (Z) 

%  Correct 

POD  (%) 

NN 

1200 

71 

N/A 

NN 

1500 

75 

100 

NN 

1800 

58 

88 

NN 

2100 

58 

100 

NS 

1200 

96 

100 

NS 

1500 

71 

100 

NS 

1800 

75 

60 

NS 

2100 

54 

100 

SN 

1200 

74 

100 

SN 

1500 

100 

100 

SN 

1800 

48 

100 

SN 

2100 

57 

100 

SS 

1200 

68 

78 

SS 

1500 

49 

67 

SS 

1800 

44 

80 

SS 

2100 

62 

75 

ALL 

ALL 

63 

85 
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One  measure  of  the  goodness  of  a 
probability  forecast  is  the  Brier  Score  (BS) 
(Brier,  1950).  The  Brier  Score  ranges  finm 
zero  (or  perfect  forecasting)  to  one  (for  no¬ 
skill  forecasting).  In  turn,  we  can  compare 
the  BS  of  a  forecast  model  to  some 
reference  standard  such  as  climatology  or 
persistence. 


Murphy  and  Winkler  (1982)  developed  the 
Brier  Skill  Score  (BSS)  to  make  this 
comparison.  The  BSS  gives  the  percentage 
increase  or  decrease  in  the  Brier  Score  of 
one  forecast  method  from  the  reference 
standard.  The  equations  for  the  Brier  Score 
and  Brier  Skill  Score  are: 


BSS 


1  - 


(  r  n 

>1  M _ 


V/-1  W 


X  100% 


where  for  n  occasions,  an  event  can  occur  in 
only  one  of  r  possible  classes;  is  forecast 
probability,  Ry  is  reference  standard 
probability,  and  Ey  is  event  probability  (0  or 
1).  Brier  scores  and  Brier  skill  scores  are 
presented  in  Table  11. 


Typically,  the  model  has  a  difficult  time 
beating  persistence  and  climatology.  The 
Brier  scores  are  low,  however,  considering 
that  the  number  of  YES  cases  for  model 
development  (dependent  dataset)  and 
verification  (independent  dataset)  were  low 
(<5)  in  many  cases. 
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TABLE  1  f .  Brier  scores  (BS)  of  discriminant  anaiysis  forecast  model  and  Brier 
skill  scores  (BSS)  for  this  model  compared  to  persistence  (Pers)  and  climatology 
(Climo)  for  indicated  upper-  and  lower-level  winds  and  3-hour  time  periods 
beginning  with  stated  hour  (Z). 


Eglin  Range 


Eglin  Main 


Wnd 

Hr 

BS 

NN 

12 

.18 

NN 

15 

.20 

NN 

18 

.15 

NN 

21 

.16 

NS 

12 

.35 

NS 

15 

.29 

NS 

18 

.28 

NS 

21 

.26 

SN 

12 

.24 

SN 

15 

.24 

SN 

18 

.26 

SN 

21 

.30 

SS 

12 

.29 

SS 

15 

.23 

SS 

18 

.20 

SS 

21 

.24 

BS  BSS  vs  Climo  BSS  vs  Pers  BS  BSS  vs  Climo 


BSS  vs 
Pers 


-367 

-124 

-103 

-15 

-107 

-24 

65 

78 

-141 

-48 

-100 

-75 

-33 

-12 

-403 

-388 

100 

100 

-221 

-323 

-102 

25 

-114 

-53 

-265 

-188 

-313 

-100 

-305 

-155 

using  the  coefficients  in  Tables  A-9  and  A- 
10  of  the  Appendix,  and  (2)  substitute  these 
terms  into  the  following  formula: 


To  estimate  of  the  probability  of 
thunderstorm  activity  during  any  of  the  four 
3-hour  periods,  you  would  (1)  calculate 
intermediate  YES  and  NO  terms 


Prob  (YESi  = 


_ 1 _ 

exp{A/0  -  YES)  *  1 


As  an  example,  if  both  the  upper-  and  lower- 
level  winds  are  out  of  the  north  and  we  want 
to  know  the  probability  of  thunderstorms  on 
the  Eglin  Range 


during  the  3 -hour  period  beginning  at  1200Z 
given  that  SSI  =  1 ,  DPD  =  30,  C  C  L  = 
1,500  feet,  and  PLFC  =  700.  The  YES  and 
NO  terms  are  then: 


YES  =  -7.38479  -  .14193*SSI  +  .07543*DPD  +  .0889*CCL  +  .0144*PLFC 
YES  =  -7.38479  -  .14193*1  +  .07543*30  +  .0889*15  +  .0144*700  =  6.14968 
NO  =  -8.26849  -  .10262*1  +  .10407*30  +  .09454*15  +  .01379*700  =  5.82209 


Therefore: 


Prob  (YES)  = 


_ 1 _ 

exp(5.82209  -  6.14968)  ^  1 


=  .5811 


With  a  probability  of  >  .50  then,, 
thimderstorms  should  be  forecast  for  the  3- 
hour  period  beginning  at  1200Z. 

4.5  Conclusion.  The  attempt  to  determine 
the  first  3-hour  period  in  which  lightning 
would  occur  was  not  very  successful;  the 
overall  correct  classification  was  only  31%. 
Additional  predictors  and  an  increased 
period  of  record  to  increase  the  number  of 
occiurences  of  lightning  may  improve  the 
predictive  ability  of  this  technique. 


Although  a  direct  comparison  of  WINNDEX 
skill  and  the  discriminate  model's  ability  to 
predict  thunderstorms  in  a  3-hour  period 
may  not  be  justified,  we  can  say  that  tlie 
discriminant  model  had  a  Heidke  skill  score 
of  .32  compared  to  .18  for  WINNDEX.  The 
discriminant  model  had  a  higher  probability 
of  detection  (88%  vs  69%)  but  the  false 
alarm  ratio  was  much  woree  (54%  vs  31%). 
Here  too,  additional  predictors  or  more 
"training"  data  may  improve  the  accuracy  of 
the  model. 
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APPENDIX 


TABLE  A-1.  Error  matrix  for  independent  classirication  of 
occurrence/nonoccurrence  of  first  lightning  strike  on  Eglin  Range  when 
both  upper  and  lower-level  winds  have  a  northerly  component  Overall 
classification  accuracy  is  25%. 


PREDICTED 


Total 


TABLE  A-2.  Error  matrix  for  independent  classification  of 
occurrence/nonoccurrence  of  First  lightning  strike  on  Eglin  Range  when 
upper-level  winds  have  a  northerly  component  and  lower-level  winds  have 
a  southerly  component  Overall  classification  accuracy  is  27%. 


PREDICTED 


None  AM  1200  1500  1800  2100  Total 


None  10 


TABLE  A-3.  Error  matrix  for  independent  classification  of 
occurrence/nonoccurrence  of  first  lightning  strike  on  Eglin  Range  when 
uppet'level  winds  have  a  southerly  component  and  lower-level  winds  have 
a  northerly  component.  Overall  classification  accuracy  is  42<Vb. 


None 


AM 


1200 


1500 


1800 


2100 


Total 


PREDICTED 


None  AM  1200  1500  1800 


100  Total 


TABLE  A*4.  Error  matrix  for  independent  classification  of 
occurrence/nonoccurrence  of  first  lightning  strike  on  Eglin  Range  when 
both  upper-  and  lower-level  winds  have  a  southerly  component  overall 
classification  accuracy  is  32<%^ 


None 

None 

1 

13 

AM 

2 

1200 

0 

1500 

1 

1800 

1 

1 

1 

2100 

1 

Total 

18 

PREDICTED 


1200 


3 


8 


1500  1800 


2100 


Total 


37 


19 


11 


15 


TABLE  A-7.  Error  matrix  for  independent  classiflcation  of 
occurrence/nonoccurrence  of  first  lightning  strike  on  Eglin  Main  when 
upper-level  winds  have  a  southerly  component  and  lower-level  winds  have 
a  northerly  component  Overall  classification  accuracy  is  26^ 


PREDIOED 


None  AM  1200  1500  1800  2100  Total 


None 


1200 


1500 


1800 


2100 


Total 


TABLE  A*8.  Error  matrix  for  independent  classification  of 
occurrence/nonoccurrence  of  First  lightning  strike  on  Eglin  Main  when  both 
upper-  and  lower-level  winds  have  a  southerly  component  Overall 
classIFication  accuracy  is  34<V!». 


None 


O 
B 

S  I 

E  I  1500 


1200 


1800 


2100 


Total 


None 


PREDICTED 


1200  1500  1800  2100  Total 
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At.  Coefficients  of  linear  discriminant  function  for  YES/NO  categorical  forecast  of  thunderstorm  activi^  on  the  Eglin  Range 
3-hour  period  beginning  with  specified  hour  (Z). 
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.01591 


ABLE  A10.  CoefTidents  of  linear  discriminant  function  for  YES/NO  categorical  forecast  of  thunderstorm  activity  on  Eglin  Nain  during 
-hour  period  begining  with  spedfied  hour  (Z). 
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ACRINABs 


ACRINAB 

BS 

BSS 

CCL 

DATSAV 

DPD 

FAR 

HSS 

NN 

NS 

PLFC 

POD 

Prob 

RW 

SN 

ss 

SSI 

TRW 

V 

WINNDEX 


Acronym,  initialism,  or  abbreviation 
Brier  Score 
Brier  Skill  Score 
Convective  Condensation  Level 
Data  Save 

Dew-Point  Depression  Sum 
False  Alarm  Ratio 
Heidke  Skill  Score 

Northerly  upper-  and  lower-level  winds  per  WINNDEX  definition 

Northerly  upper-  and  southerly  lower-level  winds  per  WINNDEX  definition 

Pressure  of  Level  of  Free  Convection 

Probility  of  Detection 

Probability 

Rain  shower 

Southerly  upper-  and  northerly  lower-level  winds  per  WINNDEX  definition 
Southerly  upper-  and  lower-level  winds  per  WINNDEX  definition 
Showalter  Stability  Index 
Thunderstorm 

Hanssen  and  Kuipers'  Discriminant  Score 

Thunderstorm  Forecasting  Technique  Developed  by  Mr  Roger  Winn 


38 


DISTRIBUTION 


HQ  USAF/XOOCW,  Rm  BD827.  Washington,  DC  20330-5054  .  1 

OSAF/SS,  Rm  4C1052,  Pentagon,  Attn:  Weather,  Washington,  DC  20330-6560  .  1 

USTC  J3/J4-OW,  508  Scott  Dr,  Bldg  1900,  Scott  AFB,  IL  62225-5357  .  1 

AWS/XTX/DO,  102  Losey  St.,  Bldg  1521,  Scott  AFB,  IL  62225-5116  .  1 

Det  4,  AWS,  Bldg  91027,  Hurtburt  FW,  FL  32544-5000  .  1 

Det  5,  HQ  AWS,  Keesler  AFB,  MS  39534-5000  .  1 

OL-N,  HQ  AWS,  ASL(SLCAS-BW-W),  Bldg  1646,  Rm  24,  Missile  Range,  White  Sands,  NM  88002-5501  .  1 

HQ  AFGWC/OOM/SY,  MBB39,  106  Peacekeeper  Dr..  Ste  2N3,  Otfutt  AFB,  NE  66113-4039  .  1 

Det  7,  AFGWC,  E  and  2nd  St..  Bldg  1750,  Carsvwll  AFB.  TX  76127-5000  .  1 

Det  11.  AFGWC,  Hickam  AFB,  HI  96853-5000  .  1 

Det  40,  AFGWC.  APO  AE  09494-5361  .  1 

AFSFC/DOM,  715  Kepler  Ave.Box  60.  Falcon  AFB.  CO  80912-7160  .  1 

OL-A,  USAFETAC,  Fedensl  Building.  Rm  305,  Asheville,  NC  28801-2723  .  1 

HQUSSPACECOM/J3W.  250  S.  Peterson  Blvd,  STE  317,  Bldg  1.  Slop  7,  Peterson  AFB,  CO  80914-3230  .  1 

USAFA/DFP,  Attn:  Capt  Paul  Bellaire,  Colorado  Springs,  CO  80840-5701  .  1 

AFMCyOOW,  Bldg  266,  Post  108P  Chidlaw  Rd.,Wright-Pattoraon  AFB.  OH  45433-5001  .  1 

FASTC/TAW,  4115  Hebble  Creek  Rd..  Ste  33.  Wright-Patterson  AFB,  OH  45433-5637  .  1 

ASD/WE,  Bldg  91.  3rd  St.  Wright-Patterson  AFB,  OH  45433-6503  .  1 

AFIT/CIR,  Wright-Patterson  AFB.  OH  45433-6583  .  1 

WUDOA,  Wright-Patterson  AFB,  OH  45433-6543  .  1 

WINDOW,  Wright  Patterson  AFB.  OH  45433-6543  .  1 

645  WS/CC,  Wright-Patterson  AFB,  OH  45433-5000  .  1 

46  TG/WE,  Holloman  AFB.  NM  88330-5000  .  1 

PL/WE,  Kirtland  AFB.  NM  87117-5000  .  1 

HQ  AFOTEC/WE.  Kirtland  AFB,  NM  87117-7001  .  1 

RL/WE,  Griffiss  AFB,  NY  13441-5700  .  1 

ROME  LAB/SUL,Corridor  W.  Ste  262,  26  Electronic  Pkwy,  Griffiss  AFB.  NY  13441-4514  .  1 

AFCESA/WE,  Tyndall  AFB.  FL  32403-5000  .  1 

325  OSS/OSW,  Florida  Ave.,  Stop  22.  Bldg  149,  Tyndall  AFB.  IL  32403-5048  .  1 

AFESC/RDXT,  Bldg  1120,  Stop  21,  Tyndall  AFB,  FL  32403-5000  .  1 

ESD/WE,  Vandenberg  Dr,  Bldg  1624,  Hanscom  AFB.  MA  01731-5000  .  1 

PUT'  -..l,  Research  Library,  Hanscom  AFB,  MA  01731-5000  .  1 

PIJGP,  Hansom  AFB.  MA  01731-5000  .  1 

3246  TW/DOW,  Bldg  60.  Rm  60,  Eglin  AFB  FL  32542-5000  .  3 

46  WS/CC,  Eglin  AFB.FL  31542-5000  .  1 

AFFTC/WE,  Edwards  AFB,  CA  93523-5000  .  1 

SMC/SDW,  PO  Box  92960,  Bldg  1 17.  El  Segundo,  Los  Angeles  AFB,  CA  90009-2960  .  1 

UTTR/WE,  Hill  AFB.  UT  84056-5000  .  1 

USAFA/CWOSW,  Air  Field  Dr.,  Bldg  9206,  USAF  Academy,  CO  80840-5000  .  1 

USCENTCOM/CCJ3-W,  Bldg  540,  MacOill  Blvd,  MacDill  AFB.  FL  33608-7001  .  1 

ESMC/WE,  Patrick  AFB,  FL  32925-5000  .  1 

OL-A,  AFCOS,  Site  R,  Fort  Ritchie,  MD  21719-5010 .  1 

USAFALCENT  RA,  Pope  AFB,  NC  28308-5000  .  1 

CCSO/FL,  Tinker  AFB,  OK  73145-6340  .  1 

AFOSRri4L.  Bolling  AFB,  DC  20332-5000  .  1 

TFWC/WE,  Nellis  AFB.  NV  89191-5000  .  1 

SMC.  Det  2/TDO,  Onizuka  AFB  CA  94088-3430  .  1 

AL/OEBE,  2402  East  Drive,  Brooks  AFB.  TX  78235-5114  .  1 

1  SOW/OGSW,  150  Bennett  Bldg  90730,  Huribuit  FW  FL  32544-5000  .  1 

HQ  AFSOC/DOW.  BWg  1,  Huriburt  FW  FL  32544-5000  .  1 

AMC/XOWR,  BWg  P40  N,  402  Scott  Dr,.  Rm  132,  Scott  AFB.  IL  62225-5363  .  1 

ATC/DOTW,  244  F  Street  East  Suite  #3.  Randolph  AFB,  TX  78150-4325  .  1 

PACAF/DOW.  BWg  1102,  Hickam  AFB,  HI  96853-5000  .  1 

USSTRATCOM/J3615,  Rm  L127,  BWg  522,  901  SAC  Blvd,  Offutt  AFB.  NE  68113-5000  .  1 

USCENTCOM/J3-W,  MacDill  AFB  FL  33608-7001  .  1 

USSOCCENT/SOCJ2-SWO.  7115  S  Boundary  Or,  MacDill  AFB  FL  33621-5101  .  1 

USSOCOM/SOJ3-W,  MacOill  AFB  FL  33608-6001  .  1 

ACC/OOW,  BWg  21.  30  Elm  St  Ste  215,  Langley  AFB,  VA  23655-2093  .  1 

1  WXG,  BWg  188,  Hardee  Stm  Ft  McPherson  GA  30300-5000  .  1 

24WS.  Unit  0640,  APO  AA  34001-5000  .  1 


39 


c 


8  COS/AOSW,  Bldg  1130.  Shaw  Dr.  Shaw  AFB.  SC  29152-5410  .  1 

1TSWCDW.  US  Army  Intel.  Ft  Huachuca  Al.  AZ  85813-5000  .  1 

1  WXG.  Bldg  168.  Hardee  St..  Ft  McPherson.  GA  30300-5000  .  1 

JSOC/Weather.  P.O.  Box  70239.  Ft  Bragg.  NC  28307-5000  .  1 

USAFE/DOW.  Unit  3050.  Box  15,  APO  AE  09094-5015  .  1 

USAFE/DOWO,  Unit  3050.  Box  500.  APO  AE  09094-5015  .  1 

17AF/DOW,  Unit  4065.  APO  AE  09136-5000  .  1 

HQ  USEUCOM  ECJ3.  Unit  30400.  Box  1000,  APO  AE  09128-1209  .  1 

7WS,  CINCUSAREUR/AREAWX,  APO  AE  09403-5000  .  1 

Army  Training  and  Doctrine  Command,  ATDO-IW  (ATTN:  SWO).  Ft  Monroe  VA  23651-5000  .  1 

COMNAVOCEANCOM.  Code  N312,  Stennis  Space  Ctr.  MS  39529-5000  .  2 

COMNAVOCEANCOM  (Capt  Brown.  Code  N332).  Stennis  Space  Ctr.  MS  39529-5001  .  1 

NAVOCEANO  (Ca.-.  .:e  Rau),  Bldg  8100.  Rm  2030,  Stennis  Space  Ctr.  MS  39522-5001  .  2 

NAVOCEANO,  Code  9220  (Tony  Ortolano).  Stennis  Space  Cir,  MS  39529-5001  .  1 

Maury  Oceanographic  Library,  Naval  Oceanography  Office,  Stennis  Space  Ctr.  MS  39522-5001  .  1 

Naval  Research  Laboratory,  Monterey,  CA  93943-5006  .  1 

Naval  Research  Laboratory,  Code  4323,  Washington,  DC  20375  .  1 

Naval  Research  Laboratory  (Dr  Riley),  Code  4180,  Washington,  DC  20375  (SESS  reports)  .  1 

Naval  Postgraduate  School,  Chmn,  Dept  of  Meteorology,  Code  63,  Monterey,  CA  93943-5000  .  1 

Chief,  APG  Met  Team,  Bldg  11 34.  Attn:  AMSTE-TC-AM  CAB.  Aberdeen  Proving  Ground.  MD  21 005-5001  .  1 

Atmospheric  Sciences  Laboratory  (SLCAS-AS-I  3  10-2c),  White  Sands  Missile  Range,  NM  68002-5501  .  1 

TECOM  Atmos  Sci  Div,  AMSTE-TC-AA  (MacBlain),  White  Sands  Missile  Range.  NM  88002-5504  .  1 

White  Sands  Met  Team.  AMSTE-TC-AM  (WS).  White  Sands  Missile  Range.  NM  88002-5501  .  1 

USA  TECOM.  ATTN:  AMSTE-TC-AM  (RE)  TECOM  Met  Team.  Redstone  Arsenal,  AL  35898-8052  .  1 

Director,  U.S.A.-CETEC.  Attn:  GL-AE  (Whitmarsh).  Fort  Belvoir,  VA  22060-5546  .  1 

Technical  Library,  Ougway  Proving  Ground,  Dugway,  UT  84022-5000  .  1 

NOAA/MASC  Library  MC5,  325  Broadway,  Boulder.  CO  80303-3328  .  2 

NOAA  Library-EC>C4W5C4.  Attn:  ACQ,  6009  Executive  Blvd,  Rockville,  MD  20852 .  1 

NOAA/NESDIS  (Attn:  Nancy  Everson.  E/RA22).  World  Weather  Bldg.  Rm  703,  Washington.  DC  20233  .  1 

NGDC,  NOAA  Mail  Code  E/GC4,  325  Broadway.  Boulder.  CO  80333-3328  .  1 

NWS  W/OSD.  Bldg  SSM  C-2  East-West  Hwy,  Silver  Spring,  MD  20910  .  1 

NIST  Pubs  Production.  Rm  A635,  Admin  Bldg,  Gaithersburg.  MD  20699  .  1 

OTIC-FDAC,  Cameron  Station.  Alexandria,  VA  22304-6145  .  2 

AUULSE.  MaxweH  AFB,  AL  36112-5564  .  1 

AWSTL.  Bldg  859  Buchanan  SL  Scott  AFB  IL  62225-5118 . 25 
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